POCUMENT RESUME 



ED 242 715 SP 024 134 

AUTHOR Kiilian, Jcjce E. 

TITIiE Teachers who Seek Coniputer Education: Their 

Attitudes, Heeds, and Motivation. 
PUB DATE 24 Apr 84 

NOTE 20p.; Paper presented at the Annual Meeting of the 

American Educational Research Association (New 
Orleans, 6ft, April 23-27^ 1984). 

PUB TYPE Reports - Evaluative/Feasibility (142) ~ 

Speeches/Conf erence Papers (150) 



EDRS PRICE MFOl/Peei Plus Postage, 

DESCRIPTORS Gomparat i%^e Analysis; *e6mpttter Literacy; Educational 

Technology; Educational Trends; Elementary Secondary 
Education; Futures (of Society) ; Bigher Education; 
Iriservice Teacher Education ; Knowledge Levelj 



Motivation Techniques; ^Teacher Attitudes; *Teacher 
Motivation 

ABSTRACT 

Teachers (nasgD who were participants in cdmputer 
literacy workshops at Southern Illinois University were compared with 
a general sample of teachers in terms of their needs, attitudes, and 
niotivation toward compute rr education. Nationwide data for comparison 
Were taken from "Computers in the Classroom: A NEA Survey Report . " 
The NEA sample of 1,700 yielded a response rate of 72.5 percent. 
Southern Illinois University workshop parti cipa 
respond to 7| items on: (J) sources of encouragement for using 
computers with students; (2) level at which participants perceived 
themselves to be informed about computer subjects; (3) interest in^ 
learning how to ttse a computer for various purposes; (4) interest in 
learning about sttbpects related to computers ih the classroom; (5J 
extent to which they believed that the future of schools and teaching 
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Abstract 

This paper compares teachers who were participants in computer literacy 
workshops \vith a general sample of teachers in terms of their needs, attitudes 
arid mdtivatiori toward computer education. Comparison of group means indicated 
sigriificarit differences on several survey items, including the following: 
workshop participants were more likely to report support from colleagues, 
administration arid studerits; they had an interest in a wider range of computer 
subjects, were less threatened by the proa'ected role of computers in education, 
and tended to shift their attitudes and interests over the course of the 
semester. 

Insight into the needs, attitudes ^ and motivation of school teachers 
and administrators who were voluntarily seeking to update their technological 
skills may give teacher educators some valuable clues as to how to stimulate 
such professional growth in other teachers. 
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Teachers Who Seek Computer Education: 
Their Attitudes^ Needs, and Motivation 

Introduction 

Recant articles in both educational journals and the popular press 
indicate consensus on two points about computer education for teachers: first, 
that teachers need computer knowledge and skills in order to promoce technologi- 
cal competence in their students; and second^ that only a small percentage of 
teachers possess this necessary computer competence. 

The objective of the present study was to identify the heeds, attitudes, 
and motivation characteristic of classroom teachers who seek to become CDmpetent 
1n the use of computers: It was predicated on the assumptions that the impetus 
for professional growth comes from the individual and that examining the condi- 
tions associated with self-initiated learning would provide insight about how 
such conditions could be promoted. 

The following specific objectives were met by comparing survey data from 
a general sample of teachers with those of teachers who had sighed up for a 
workshop in computer literacy: 

(1) to describe similarities and differences between the workshop partici- 
pants and the general teacher sample in terms of their attitudes^ 
needs, and motivation related to computer education; 

(2) to identify and discuss factors associated with teachers' predispositions 
to seek computer education; 

(3) to identify changes in attitudes and perceptions of need among teachers 
who have become more competent and knowl edgeabl e about computers; 

(4) To recommend policy at district and university levels that will promote 
factors associated with professional growth in computer literacy. 
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Methods and Data Source 

The Subjects 

Mationvvide aata for cdmparisoh were taken from ''Computers in the Classroom: 
A NEA Survey Report" (C. Nonnar, National Education Association, 1982). The 
NEA sample of 1700 teachers was selected randomly from active membership files. 
Surveys were sent and collected by mail. Initial and follow-up mailings 
yielded a usable response rate of 72. 5^. 

The data on teachers who seek computer education was collected from 61 
students who took CIM 4g8M, Workshop in Computer Literacy, through Southern 
Illinois University during the summer and fall of 1983. Four sections of this 
course were taught during this time period, one on campus and three at local 
school district sites. The courses were taught by three faculty members from 
the Department cf Curriculum, Instruction^ and Media. Students were employed 
in both elementary and secondary settings^ with close to 20?^ employed in 
positions as other than classroom teachers. This latter group included 
administrators, media specialists and students who had recently completed 
student teaching: Surveys conducted on workshop participants were administered 
during the first or second class meeting of the course and returned to the 
researcher by the course instructors. 
The -Sur-vey- 

The original MEA survey consisted of 133 items for all respondents and an 
additional 45 questions for teachers who were currently Using computers. It 
elicited responses about teachers' knowledge of computers, their instructional 
experience with them, and their opinions about a number of computer-related 
topics. Items were written in alternate- or multiple-choice format. 

For the purpose of the present study, only those sections which yielded 
information about teacher motivation, needs, and attitudes were included. 
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Participants were asked to respond to 78 items bri the fdlldwirig topics. 

(1) sources of ehcouragen ^ht for using computers with students^ 

(2) level at which participants perceived themselves to be informed about 
computer subjects; 

(3) interest in "'earning how to use a comiDUter for various purposes j 

(4) interest in learning about subjects related to computers in the 
el assroom; 

(5) extent to which they believed that the future of schools and teachirici 
would be influenced by computers; 

(6) extent to which they believed that aspects of their teaching careers 
would be influenced by the computer movement. 

To meet the needs of the present study, three additional items were added 
to the NEA survey. Workshop participants were asked about the extent of their 
past computer experience as well as their interest in wD>"d processing and data 
management soft^.are. 
Statisti cal Analysi s 

Procedures for NEA data analysis are described in the survey report avail- 
able through the National Education Association. These descriptive statistics 
provided the basis for comparison with responses frnm workshop participants. 

Descriptive statistics for the workshop participants were obtained through 
the use of the SPSS frequencies program. Comparison of the two groups was 
accomplished by tests of significant differences: For items which yielded 
proportional data, a 2-test for significant difference in proportions of 
independent data was used. For the majority of items, which yielded responses 
based on a continuum, a t-test for significant difference in means was employed; 
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Comparison of Workshop Participants With the Seneral Teacher Sample 
Sources of Encouragfime:n-t 

Table 1 indicates that, when asked who had encouraged tham to use compot^rs 
with their students, a significantly higher percentage of workshop participants 
reported encouragement from teaching colleagues, family and friends, principals, 
"students^ superintendents, curriculum specialists and school boards: 

(Insert Table 1 here) 

Level of Informatidn^ 

Respondents in both groups were asked to rate themselves on how well 
informed they were, using a scale from 1 (not well informed) to 4 (very well 
informed). Table 2 indicates that for both groups, mean responses were between 
1 and 2 on all subjects. The mean response for NEA respondents was significantly 
higher than the mean for workshop participants in the areas of being informed 
about commercial software, the criteria for selecting software, and how to 
write a computer program. 

(Insert Table 2 here) 
Interest in beaming to Use a Computer 

When asked to rate their interest in various subjects on a scale of 1 
(little interest) to 4 (great interest)^ the mean response for both NEA and 
workshop participants v;as between 2 and 3 on most items. Table 3 irJicates 
that the mean responses for workshop participants were significantly higher 
than for NEA respondents in the areas of computer literacy, simulations, and 
maintenance of student records. 

Response of workshop participants to two items not included in the 
original NEA survey indicated that word processing and data management were of 
high interest: 

( Insert Table 3 here) 
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■•^J^j^g^^A^, 11 J- gg^'^J Computer Related Subjects 

Survei' takers were given a list of computer-related subjects and asked 
to check all of those in which they vvere interested. Table 4 indicates that 
a Significantly higher percentage of workshop participants were interested in 
learning about the following subjects: computer instructional applications, 
how to operate a computer, how to write computer programs^ how to select 
eommereial courseware, programming languages, curriculum design for computeriza- 
tion, educational policy for computers, computer users' network, computer 
history, and courseware copyright protection. 

(Insert Table 4 here) 
£utura--ifflMct--&t JSorapu.ters on S chools and Teaching 

■ Li* 1^ ■■■ ' » ■ ^ 'I'll *" "* "■■,,■■-■11 ■ in 1 — — 

Table 5 indicates that when respondents were asked to rate the extent to 
which they believed that certain events would occur by 1990 on a scale from 1 
(unlikely to occur) to 3 (very likely to occur), mean scores for workshop 
participants were significantly Higher on all items dealing with the growing 
role and importance of computers in education. In their mean scores on one of 
the negative irnpl icatiohs of computers, i.e., that computers will replace some 
teachers, NEA respondents were significantly higher. 

(Insert Table 5 here) 
Mf-t^A^-g^ t i^^P^^ Aspects of Teaching Career 

When respondents wore asked to rate the effect that the computer movement 
would have on their careers on a scale from 1 (negative effect) to 3 (positive 
effect), mean ratings for workshop participants were higher for all but one 
itern. Workshop participants were significantly more positive about the impact 
of computers on all of the following aspects of their teaching careers: 
professional challenge, teaching effectiveness, job satisfaction, subject 
assignrnent, teaching certification, and salary; 
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( Insert Tabi e 6 here) 
Changes in Needs and Attit4Jctes-ATOfig4^lcstop-P^^ 

When the NEA items dealing with interests and beliefs were administered 
near the end of two of the workshops, significant differences were apparent 
oh several items. Pdst^cdurse respondents were more likely than pre-course 
respondents to express an interest in developing a network of computer users 
and were stronger in their advocacy of each of the following school district 
policies: adequate hardware and software provisions for computer projects; 
adequate support services for computer projects; and adequate preservice and 
inservice training to support computer projects. 

Di scussion 

Comparison of the general sample of teachers with teachers who had signed 
up for a computer literacy workshop revealed that certain attitudes, interests, 
and sources of encouragement were more prevalent among those who sought to 
update their skills. When the variables associated with these computer 
literacy "seekers" are of the type which can be controlled or manipulated in 
the school environment, the findings may have clear implications for teacher 
educators, supervisors, and staff developers. 
Bifferences in Sources of Encouragement 

When asked about the sources which had encouraged them to use computers 
with students, "seekers" named many sources from //ithin the school environment, 
including students, colleagues, and admiri str: cors . The fact that so much of 
their perceived support came from within the schools implies that providing 
a nurturing climate at the building level may be a starting point for staff 
development for computer competence. 
ELi^feren^es in-J^nowl edge and Skills 

Prior training or experience apparently did not make teachers more likely 
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to sign up for a course in computer literacy; the oeneral sample were quite 
similar to the workshop group in their lack of a computer background; Both 
groups rated themselves low in knowledge about dll computer subjects; and 
"seekers" were even lower than the yeneral group on several self-estimates of 
knowledge. Whether their comparative ignorance was real or perceived, the 
perception of being "illiterate" may be a factor in getting teachers to 
realize that computer training would be beneficial. Thus staff development 
should include a plan to help teachers to analyze the extent of their knowledge 
about computers. 

Differences in C omputer Interests 

Computer "seekers" reported a significantly higher interest in many 
subjects and uses for the computer than did the general sample of teachers. 
Some information not included in the survey data is pertinent to this difference: 
though most of the workshop participants reported little or no computer training, 
the majority of them came from school districts which had included a computer 
orientation component in recent inservice programs. Because they had at least 
a superficial exposure to the vocabulary associated with computers, they may 
have been more likely to recognize and identify the area^ of interest listed 
on the survey. It seems plausible that teachers need to, know a little about 
c:mDute^s before they can identify their interests. Thus ^ brief, practical 
school or district-wide orientations to computers could put teachers in a better 
position to articulate their needs and interests. 
Dif ferences in Be liefs and Attitudes 

Workshop participants were clearly more positive in cheir perceptions of 
how computers would influence schools and teaching, as well as their own 
teaching careers. Though these positive atittudes reflected individual pre- 
dispb'^i tions as well as the way that computers had been introduced into their 
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school districts* computer beliefs and attitudes appear to be at least to 
some extent affected by the school district environment. Thus, it would seem 
reasonable to use school district resources to promote positive attitudes 
toward computers through such programs as networking and interest groups as 
well as lenient policies toward observing in other schools and attending 
cbmputer conferences and exhibits. 
Differences in Pre- and, Pgst-Wcrkshdp Surveys 

In pre-course surveys, participants indicated that they had had little 
computer experience, classifying themselves as i 1 1 -i nfdrnied about most subjects. 
Though they had heard of programming and software packages, they did not under- 
stand how the various programs could apply to education. When asked about 
their interest in such uses as word processing-, simulations ^ or data management, 
many responded with a question mark. 

By the end of the workshop, participants differed from the general sample 
as well as from their own pre-course" ratings in terms of their computer 
interests. They saw more of a need for computer networking ar:idng teachers 
and were firmer about the policies that they felt school districts should adopt 
to promote Ton^-ranqe integration of computers into the curriculum. 

Additional evidence of change was evident in open-ended survey questions 
admi ni ster'ed as part of the formative needs assessment for the course. 
Responses on these indieated a shift from a strong desire to Focus on BASIC 
programming to a perception of greater need for software review and evaluation 
arid for learning word processing and data filing systems. 

implications for Staff Development 

Of major interest to anyone seeking to promote continuing education among 
teachers is information about the intended recipients and what leads them to 
seek professional self-improvement. Attitudes, needs, and motivation revealed 



U 

ERIC 



by the literacy-seekers in this study my give teacher educators sortie valuable 
clues about how to stimulate this part ici pati on from other educators. Their 
survey responses ^ as well as other heeds assessment and goal -setting throughout 
the workshop^ provided the basis for the following generalizations about 
conditions which will provide a climate nUrtUraht of computer competence 
among teachers. 

Minimize the threat that m any te achjrs associate with computers . Teachers 
who sign up for computer workshops have generally positive attitudes toward 
the role of computers in education and did no^ perceive conputers as the poten- 
tial displacers of teachers as many of their colleagues in the general sample 
did. Coercing or requiring teachers to use computers or take computer course- 
work is likely to intensify fear and r^^sistance. A more productive approach 
is to make equipment available where teachers can experiment with it in a non- 
threatening environment. Voluntary learning is associated with encouragement 
from students, colleagues, and administrators, so time and resources should be 
provided to encourage these contacts and other types of informal computer net- 
working. Similarly, teachers who are involved in making the decisions about 
how computers can best be used in their schools are less likely to impute 
sinister motives to their introduction. 

G-ive-4:eachers and ad mi ni stra tor: an acti ve role in s chool district 
c omput^r^l icies . Voluntary participants expressed their oeiief that teachers 
should be part of the decisions about the planning for future inservice 
programs as well as the priorities for computer acquisitions. Post-workshop 
cdmnients indicated that examination of commercially available software had 
made participants aware that publishers' claims about ease of use, appropriate- 
ness to certain subjects and grade levels, and advantages over conventional 
presentation methods were often overstated or inaccurate; Because teachers are 
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rtidre likely to be able to judge the merits of software "designed for their 
particular grade or subject area, they should be encouraged to preview and 
evaluate such materials. 

'Administrators and supervisors from the school board on down to the 
building level are more likely to encourage computer use if they understand 
and use a system themselves. Regardless of their expertise, however, staff 
should not bypass teachers in their long- and short-range computer decisions. 

Relate computer inservice to practical needs and interests of participants 
Voluntary participants are more interested in practical, ha^^-ds-on experiences 
than they are in talk about computers. Once they understood what the various 
terms meant, participants were primarily interested in software packages. 
Specific programs receiving high priority included word processing, simulations 
record-keeping, and enrichment. Topics like the history of computers or their 
edacational implications received low priority, at least until participants 
had attained a certain level of practical competence. 

introductory material in computer literacy programs necessarily includes 
a common core of definition and demonstration of computer use. Beyond this 
level, however, the content of computer inserviee should vary as widely as the 
needs of its participants. 

XreaL-need-S^ assessment and goal -setting as an ongoing process . Needs and 
goals often shift as participants become more literate and competent in their 
knowledge and use of computers. Frequently they need to spend some time 
working with a certain type of software before they can understand its personal 
application. In pre-course surveys, participants expressed the need to learn 
to program as their top priority. By the end of the course, though they had 
spent several sessions learning to program in BASIC, they no longer saw it as 
a priority. Goals for future inservice were more likely to include word 
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processing, data management and authoring systems than they were to include 
programming: Selection of a final project revealed a similar trend. When 
participants were asked to work with one coarse component in depth, by far the 
greatest number of participants chose to run and review software programs 
appropriate to their grade or subject area: Yet software eva. nation had been 
well behind programming as a priority when they started the course. 
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Table 1 

A Copiparisbh of NEA agd/Wdrkshop .Respons e Sources o f 

EhcbUraqerTieht to Use Corhputers With Students 



Source of 
Encouragement 



NEA Respondents Worksho p Respondents 

Percent of Percent of z Test of 

"Yes" Response "Yes" Response Proportions 



Teaching 
Col 1 eagues 

School 
Principal 

Family, Friends 

Stadents 

Local Qr State 
Associ ation 



Carri ctil um 
Special ist 

School 
Superintendent 

Sabject Matter 
Srgani zation 

Individual 
Parents 

School Board 

Parent Groups 

Commu ni ty 
Groups 

*p <^ .05 



35.1 

24.5 
21 .7 
18.8 

14.0 

13.4 

12.6 

19.6 

10.0 
9.6 
5.4 

3.5 



52.5 

39.0 
49.2 
37.3 

18.6 

25.4 

35.6 

15.3 

10.2 

28:3 

10.2 
5.1 



-2.71 



•2.50* 

■4.87*** 

■3.47*** 



- .982 
-2.58** 
-4. 97*** 
-1.13 

- .05 
-2.54*** 
-1 .55 

- .541 



P < -01 



< .001 
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Table 2 

i\ Compar-i'-! 



-N£fi- and Hdrkshdp -Response-S- Abo-C 



-Res-f 



i nform ed- on- Computer Subjects 



NEA Respondents Workshop Respondents 

Mean _ Mean 

Response _Staridard Response Standard 

ter Subject Score Deviation Score Deviation 



Kinds of Eomputer 
Marketed 1^51 .794 

Parts of System 1.46 .772 

Qperati onal 
eharacteristics 1.55 .801 

How to Operate 
a Computer 1 .60 .821 

Commercial 

Software 1 .47 .750 

Commercial 
Courseware 1 .40 .706 

Criteria for 
Selecting 
Computer 
Program for 

Instruction 1.32 .594 

How to Write 
a Computer 

Program 1.40 .777 



1 .51 
1 .53 

1 .49 

1 . 64 

1 .31 

1 .30 



1 .12 



1 .20 



,640 
,698. 



.708 
.534 
558 



370 



,480 



.000 
- .706 

.819 

■ All 

2.23* 

1 .34 



3.89^ 



3.03^ 



< .05 



**p < .01 



***p < .001 
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Table 3 

A Comparison, of NEA and/Workshop Response6-ft 6au:^4nte.^t_-j-ri- 
Learning to Use a Computer for a Specif ic -Panose 



NEA Respondents Workshop -ResfMsndwts- 

Mean Maan 
Purpose of Response Standard Response Standard 

Computer Use Score Deviation Score Deviation t 



Drill S Practice 


2, 


.37 


1 .873 


2, 


,66 


1 .035 


-2 


.08* 


Remedial Brill 


2. 


,68 


1 .092 


2, 


.88 


1 .027 


-2 


.02* 


Ehrichtnent 


2, 


.86 


1 .877 


2 , 


, 98 


1 ACT 

1 .051 




, o4o 


Computer 
Li teracy 


2. 


,37 


1 .079 


2. 


,78 


1 .093 


-2, 


. 79*^ 


AV to Accompany 
Preseritatidh 


2, 


.29 


1 .056 


2 


.51 


1 .037 


-1 . 


.55 


Standardize 
Presentation 


2. 


,38 


1 .049 


2. 


,43 


1 .093 




.871 


Moni tor. 
Student 
Mastery 


2, 


.41 


1 .075 


2, 


.68 


.972 


-1 . 


.45 


Testi ng to 

Monitor Progress 


2, 


,58 


1 .069 


2. 


.59 


.937 




.709 


Simul ati dns 


2, 


.74 


1 .053 


3, 


.85 


.999 


-2. 


,38* 


Computer Games 


2, 


.51 


1 .875 


2, 


.79 


1 .074 


-1 , 


.91 


Maintain Student 
Records 


2, 


.68 


1 .148 


3. 


.82 


1 .051 


-2, 


.39* 


- # 

Word Processing' 








3, 


.09 


1 .04 






Data Management 








2, 


.97 


1 .159 







*p< .05 

^These categories .were not included in the. original form of the NEA 
Survey, so data is available only for workshop participants. 
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Table 4 

A Cgrnpjj-lson- gf -NEA and-Wp-r-kshpp Responses- Atwjt 
Intergst_i_n Computer Subjects 



NEA Res pondents Workshop Respomdents- 

Percent of Percent of -Z Test. of 

Cornpute^ Subject "Yes" Response "Yes" Response Proportions 



Computer 
Instructional 
Applications 59.1 

How_to Operate _.. _ 

a Computer 58.8 

How to_ Mri te 

Computer Programs 56.6 

How to Select 
Commercial 

Courseware 42.3 
Programining 

Languages 39.0 

Curriculum Besigri 
For Computeriza- __ _ 
tion 35.6 

K-12 Computer 
Science 

Curriculum 22.1 

Educational 
Policy for __ _ 

Cemputers 22.2 

Computer Users 
Network 19.2 

How to Teach 
Computer Science 18.5 

computer History 11.7 

Courseware Copy- 
right Protection 9.9 



80.7 
81 .0 
76.8 

79.3 
63.8 

52.5 

23.7 

40.0 

29.5 

18.3 
24.6 

24.5 



-3.36*** 
-3.45*** 
-3.11** 

-5.68*** 
-3.85*** 

-2.68** 

- .29 

-3.46**^ 

-1.97* 

.059 
-2 . 99** 

-3.64*** 



*p < . 05 



p<.odi 
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Table 5 

A Ccifnparison of NEA and WprksHDp-Respons es About F -utur-a 
Irtipact of Cdrtiputers dh Schools and T-each-i-n-g- 



NEA Respondent: 



ERIC 



1990 Event 



beaming by 
Gomputer 9ut-_ 
side of School 
will be eommon 

Mos L Publ i c 
Schools will 
Have Computers 
In the Class- 
rddrri 

Knowing How to 
Use a Comptjter 
Will be 
Regarded as a 
Basic Ski 1 1 

Schools Without 
a Cdmputer 
CUrri cUl Um wi 1 1 
be Regarded as 
Inadequate 

Teachers with 
Computer Ski 1 Is 
Mil 1 be 
Great Demand 

Computers wi 1 1 
Render Man3' 
Teaching Skills 
Obsolete 

Computers Wi 1 1 
Stimulate 
Innovati ve 
Teachi ng 

Computers _wi 1 1 
Replace Some 
Teachers 



Interest in 

Computers Will 
Wane 



Works hop- R es pendent s 

Mean Mean 
Response Standard Response 
Score# Beviation Scored 



.Standard 
Deviation 



Learning by 
Computer in 
School wi 1 1 te 
Common 



2.44 



2.40 



2.37 



2.41 



2.29 



2.51 



1 .71 



2.41 



1 .64 



1 .45 



,618 



,681 



,708 



,553 



719 



575 



732 



,618 



704 



,628 



2.77 



2.72 



2.69 



2.71 



2.51 



2.78 



2.51 



2.67 



1 .45 



1 .43 



,4^2 



.490 



,620 



,558 



.555 



,418 



705 



510 



,580 



.415 



-5.34*** 



.82' 



-3.90*** 



-4.05*** 



-2.91 



** 



■2.98** 



■8.55' 



-3.80*** 



2.07' 



35 



*p <.05 
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**p<.01 



***p < .001 



Mean __. . Mean 



_ Aspect _of 
Teaching Career 


Response 
Score# 


_Stahdar(d 
Deviation 


Response 
Score* 


Standard 
Devi at ion 


t 




Professional 
6hal 1 enge 


2, 


.74 


.501 


2, 


.98 


.139 


=9, 


,67*** 


Teaching 
Ef fecti veness 


2, 


,66 


.536 


2 


.89 


.317 


-4; 




Job Satisfaction 


2, 


.55 


.579 


2 


,80 


.448 


= 3. 


.66*** 


Subject 
As si gnment 


2, 


.28 


.555 


2 


,44 


.563 


-2. 


67* 


Teaching 
Certi fi cation 


2: 


.21 


.551 


2, 


,38 


.491 


-2. 


,30* 


Grade Level 
Assi gnrrierit 


2. 


18 


.480 


2. 


26 


;444 


-1 . 


19 - 


Salary 


2, 


.B7 


.509 


2, 


,32 


.515 


-3 . 


,25** 



*p<.05 **p< .01 ***p<.0Ol 

it _ _ _ _ - _ _ - 

^No opinion responses deleted from cal culations » 
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